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ABSTRACT 



A method and apparatus for displaying three dimen- 
sional surface images includes the utilization of a case 
table for rapid retrieval of surface approximation infor- 
mation. Eight cubically adjacent data points associated 
. with a given voxel element are compared with a prede- 
termined threshold value or range to generate an eight 
bit vector. This eight bit vector is employed to rapidly 
produce vector lists of approximating surfaces. An in- 
terpolation operation is performed so as to more closely 
approximate the desired surface and to provide more 
accurate representations of vectors normal to the de- 
sired surface. The accurate representation of these nor- 
mal directions provides means for accurately represent- 
ing shading information on a display screen. The 
method and apparatus of the present invention are par- 
ticularly useful for the display of medical images both, 
from x-ray generated data and from data generated 
from various other sources including magnetic reso- 
nance imaging and positron emission tomography. The 
present invention provides a means for rapid generation 
of three dimensional images so as to enable interactive 
use by medical practitioners. 

16 Claims, 55 Drawing Figures 
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operator of the present system can also select the appro- 

SYSTEM AND METHOD FOR THE DISPLAY OF priate viewing angle and can, at will, selectively ignore 

SURFACE STRUCTURES CONTAINED WITHIN segments of the data generated in order to provide cross 

THE INTERIOR REGION OF A SOLID BODY sectional views through any desired plane. Moreover, 

5 the viewing angle is selectable and it is possible to gen- 

BACKGROUND OF THE INVENTION erate a sequence of images and display them sectentially 

The present invention is generally directed to a sys- t0 P rovide the medical practitioner with interior views 
tern and method for displaying surface information. The °f solid surfaces m a truly three dimensional manner 
images of the surfaces displayed are typically contained from any desired viewing angle with the further capa- 
within the interior regions of solid bodies which are 10 bility of being able to construct a view through any 
examined by computed axial tomographic (CAT) x-ray plane or slice. Again, it is pomted out that for many 
systems or by nuclear magnetic resonance (NMR) im- purposes, an almost infinite variety of meaningful im- 
aging systems either of which is capable of generating ages may be created from only a single set of NMR or 
three dimensional arrays of data representative of one CAT scan slice data arrays. Certainly though, if the 
or more physical properties at various locations within 15 objective of the medical investigation is the study of 
a three dimensional volume. More particularly, the internal anatomic variations as a function of time, then it 
present invention is directed to a system and method for is meaningful to produce a sequence of three dimen- 
the display of medical images so as to obtain images and sional data arrays indexed by time. The system and 
representations of internal bodily structures. The im- method of the present invention provide the medical 
ages generated in the practice of the present invention 20 practitioner, and surgeons in particular, with the ability 
provide three dimensional data for examination by phy- to plan detailed and complicated surgical procedures 
sicians, radiologists, and other medical practitioners. using totally non-invasive diagnostic methods. The 
The present application has been filed concurrendy images generated by the present invention can only be 
with application Ser. No. 741,391. described as truly dramatic and show every evidence of 

In conventional x-ray systems, a two dimensional 25 bcing M great an improvement in the medical imaging 
shadow image is created based upon the different x-ray ^ M com puted axial tomography and nuclear mag- 
absorption characteristics of bone and soft tissues. A netic resonance imaging. 

great improvement on the conventional x-ray system as WMe the system and method of the present invention 
a diagnostic tool was provided by the computed axial win m^otedy f md i ts greatest utilization in the anal- 
tomographic systems which have been developed over 30 ^ 0 f tomographic x-ray and nuclear mag- 
the last ten years or so. These so-called CAT systems ^ resonance datfli ^ system 0 f the present 
are x-ray based and initially were used to produce single mvemion ^ uaU applicable to system employing 
two dimensional views depicting transverse shces of a ^tiwouiid, positron emission tomography, ECT (emis- 
body, object or patient bemg mvesUgated Tfcee di- £ tomography) and MMI (multimodal^ 
mensional information was thereafter gleaned from 35 taa ^ } P Mor ^e the present invention is par- 
CAT scan data by generatmg data for a number of construction of medical im- 
conttgous slices and using the inferential abilities of the * ^ of 
radiologist to suggest a three dimensional representa- a ° ra ' " ; . v *T . .. ' . ,. . , 
tion fo/the variou internal organs. In one embodiment ?» » ^^^J^t^ 
of the present invention, shaded and contoured three 40 ^nor three dimens.onal surface smictures for any 
dimensional images are generated from the three dimen- *J*™ whlch is capable of generatmg three d.mensional 
sional array of data generated by a sequence of such <kta arrays in which signal patterns are present which 
contiguous CAT scans. In the same way, the newer represent the value of at least one physical property 
NMR imaging technology is also capable of generating associated with points m a solid body, 
three dimensional arrays of data representing physical 45 A particular advantage of the present mvention is its 
properties of interior bodily organs. Moreover, NMR abihty to provide the medical practitioner with the 
systems have the capability to better discriminate be- abUity to perform interactive functions with the ma- 
twees various tissue types, not just bone and soft tissue. chine in real time. Systems which do not permit interac- 
NMR imaging systems are also capable of generating tive use suffer a significant disadvantage since a reid 
physiological data rather than just image data. How- 50 time display methodology is required for optimal 
ever, whether NMR or CAT systems are employed, the human interaction with the system, particularly in the 
data has been made available only as a sequence of slices case of a surgeon planning a difficult procedure. For 
and systems have not generally been available which example, in transplant surgery, it is often difficult to 
provide true three dimensional images. ascertain beforehand the precise shape or size of a body 
In the present invention, three dimensional data gen- 55 cavity which is to receive the implant. This is true 
erated either by a CAT scanning system or by an NMR whether or not the implant comprises human tissue or a 
imaging system may be displayed and analyzed in a mechanical device. It is therefore seen that it would be 
plurality of ways so as to produce on a display screen or very important for a surgeon to be able to display the 
other device a multitude of anatomical features which cavity in question on a screen in three dimensional form 
are selectable at the viewer's choice. In the system and 60 and be able to rotate it and section it at will, before any 
method of the present invention, the data used to pro- invasive procedure is undertaken. It is also important to 
duce the three dimensional images is typically acquired such medical practitioners that the images generated are 
once and then used and re-used to generate medical sharp and exhibit excellent contrast. The images gener- 
information and display images at the option of the ated should also depict surface texture wherever this is 
viewer. The viewer is provided with the option of se- 65 possible. 

lecting one or more threshhold values which determine, The display of three dimensional graphic images on a 

for example, whether or not bone surfaces as opposed to cathode ray tube (CRT) screen has principally been 

brain surface tissue is to be displayed. The viewer or driven by the goals and directions of computer aided 
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design (CAD) and computer aided manufacture 
(CAM). Systems have been developed for displaying 
solid bodies and for manipulating images in desirable 
fashions to create solid models for manufactured parts 
and for rotating and viewing these parts from a multi- 5 
plicity of directions. In particular, CAD/CAM systems 
have been developed which accept so called wire-frame 
data. In a wire-frame display format, the display proces- 
sor is provided with a sequence or list of three dimen- 
sional points representative of the end points of line 10 
segments. These line segments are joined to represent 
various surfaces. An advantage of these wire frame 
images is the ability to rapidly rotate the image about 
various axes to obtain different views. This is actually a 
computationally burdensome task which has only re- IS 
cently been satisfactorily solved through the utilization 
of high speed, large scale integrated circuit devices. A 
wire-frame image, even one which has been processed 
to eliminate hidden lines, may typically comprise a list 
of 50,000 vectors which is displayed on a screen, each 20 
"vector" being a (directed) line segment drawn be- 
tween two points by a CRT form of display device. 
More sophisticated graphics processing systems not 
only accept wire-frame data, but also perform functions 
such as hidden line removal and continuous shading in 25 
various colors and/or in various shades of gray. In such 
systems, the viewing angle is selected by the operator. 
In systems displaying shaded images, the normal vector 
to the surface being displayed varies from point to point 
on the surface and the shading is determined from this 30 
normal vector and the viewing angle. Thus, it is seen 
that the information provided by the normal vector is 
very important in the shading which is applied to what 
is in actuality a two dimensional CRT screen image. It 
is the shading of this image (based originally on wire- 35 
frame data) that creates a very effective illusion of three 
dimensions. It is the providing of these three dimen- 
sional clues (shading) to the human visual system which 
is achieved particularly well in the system of the present 
invention. The shading data is generally produced from 40 
wire-frame data in various graphics processing systems 
which operate to convert the vector format of wire- 
frame images to the so-called raster scan format. It is the 
raster scan format that is most familiar to the television 
viewer. In general, computer graphics display systems 45 
and display methodologies are divided into vector 
based systems which are particularly appropriate for 
line type drawings and raster format systems which 
produce images which are more closely related to that 
which is seen by the human eye. 50 

Related work in the field of displaying three dimen- 
sional images has been carried out by Gabor Herman 
who has employed a method in which each adjacent 
volume element is analyzed and quantized to discrete 
zero and one values. Surface approximations are made 55 
only by considering cube faces and surface normal in- 
formation can only be partially reconstructed because 
of the quantization step that is performed. The resulting 
method also is computationally long and produces low 
resolution images and appears be slower than the pres- £0 
ent method for interactive use at this time. 

Meagher, working for Phoenix Data Systems, has 
employed a method of octree coding in which the three 
dimensional data array is subdivided into eight regions 
and each region is subdivided until individual volume 65 
elements are formed. Regions not containing surfaces 
are not subdivided. However, this method requires 
special purpose hardware, while the images are crisp, 



individual volume elements produce a quantized artifact 
that is not observed in smooth tissues such as bone. 
Furthermore, octree encoding methods are incompati- 
ble with polygonal surface descriptions which are used 
in most of the advanced graphics display systems that 
have been developed for CAD/CAM technology. 
Other methods for displaying three dimensional data 
are; for example, described in U.S. Pat. No. 4,475,104 
issued Oct. 2, 1984 in the name of Tsu Y. Shen. This 
patent appears to disclose a three dimensional display 
system which incorporates a depth buffer to provide 
separate 3D information as part of the mechanism for 
generating appropriate shading values. 

Accordingly, it is seen that it is an object of the pres- 
ent invention to provide a system and method for the 
display of three dimensional information. 

It is a further object of the present invention to pro- 
vide a display system for use in conjunction with CAT 
scanners, ultrasound devices, NMR imaging systems, 
and any and all other systems capable of generating 
three dimensional data representative of one or more 
physical properties within a body to be studied. 

It is yet another object of the present invention to 
provide a graphics system for medical images which is 
capable of interactive use and yet at the same time pro- 
duces high quality images providing textural, shading, 
and other visual clues to the user. 

It is yet another object of the present invention to 
provide a three dimensional graphics display system 
which is compatible with current CAD/CAM systems. 

Another object of the present invention includes the 
ability to generate and display three dimensional wire 
frame information. 

Still another object of the present invention is to 
maximize the information contained in a three dimen- 
sional data array for the purpose of surface representa- 
tion. 

It is also an object of the present invention to provide 
a system and method which is readily fabricatable in 
specialized electronic hardware including integrated 
circuit chips and read only memory (ROM) devices. 

It is yet another object of the present invention to 
provide medical practitioners with the ability to emu- 
late surgical procedures graphically prior to undertak- 
ing invasive measures. 

Additionally, it is an object of the present invention 
to provide a plurality of three dimensional surface 
views from a single set of collected data. 

Lastly, but not limited hereto, it is an object of the 
present invention to provide a system and method for 
display of three dimensional images of internal surface 
structures in such a way that the specific viewing angle 
and cross sectional viewing plane may be selected by 
the user in an interactive manner. 

SUMMARY OF THE INVENTION 

In accordance with a preferred embodiment of the 
present invention, a system for displaying three dimen- 
sional surface structures comprises means for storing 
three dimensional signal patterns which represent the 
value of at least one physical property which is associ- 
ated with a three dimensional body at rectangularly 
spaced grid locations within a body. The system in- 
cludes means for retrieving eight adjacent signal pattern 
values, these values being located at cubically adjacent 
grid locations. As used herein and in the appended 
claims, the term "cubically adjacent" refers to grid 
locations which exist at the eight corners or vertices of 
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a cube, or more generally, a parallelopiped. The system 
also includes means for comparing each of these eight 
cubically adjacent values with a predetermined thresh- 
old value or range of values so as to generate an eight 
bit binary vector which is used herein as an addressing 5 
or generation mechanism. The system also includes 
means for generating a set of coordinate values for each 
of the distinct binary vectors generated. These coordi- 
nate values represent the vertices of at least one prede- 
termined polygonal surface which approximates the '0 
intersection of surfaces determined by the threshhold 
value with the volume defined by the eight grid loca- 
tions. In general, these coordinate values are also se- 
lected to be dependent upon the location of the eight 
grid points within the body. A preferred embodiment of 1S 
the present invention further includes display processor 
means for receiving the coordinate values and for con- 
verting these coordinate values to a particular display 
format. The preferred embodiment also includes means 
for displaying surfaces determined by the threshhold, 
the display means being driven by the display proces- 
sor. 

In accordance with a preferred embodiment of the 
present invention, a method for producing three dimen- ^ 
sional surface representations on a display device such 
as a CRT screen includes the steps of generating three 
dimensional signal patterns in which the signal patterns 
represent the values of at least one physical property 
associated with a three dimensional body at regularly 3Q 
spaced grid points throughout the body. These three 
dimensional signal patterns are employed to generate an 
eight bit vector for each set of cubically adjacent loca- 
tions throughout the body. The vector is determined by 
comparison of data values representing the physical 35 
property with a predetermined threshold value or range 
of values. This eight bit vector is used to generate a set 
of coordinate values for each of the 256 distinct eight bit 
vectors. The coordinate values generated represent 
vertices of at least one predetermined polygonal surface 40 
which approximates the intersection of surfaces deter- 
mined by the threshold value with the volume defined 
by the eight grid locations. These coordinate values also 
depend upon the location of the grid location within the 
body. These coordinate values are supplied to a display 45 
processor and display device for a generation of three 
dimensional images of at least one surface within the 
body, this surface being determined by the threshold 
value or values. 

In the display of three dimensional surface pictures, so 
say for example, on a CRT screen, it is very important 
to provide visual clues to the human eye with respect to 
orientation of each part of the surface. These visual 
clues are provided by shading the various triangular or 
polygonal surface elements which are displayed. For 55 
example, the more closely the normal direction to the 
surface is to the viewer's line of sight, the lighter is the 
shading that is applied (at least for positive rather than 
negative images). Surface segments which exhibit nor- 
mal directions with components directed away from the 60 
line of sight represent surface structures which are not 
visible and therefore these normal directions provide a 
mechanism for eliminating the surface element from the 
view for a particular viewing angle. Surface elements 
having normal vectors with substantial components in a 65 
direction orthonogal to the viewing direction are repre- 
sented by more darkly shaded surface elements. As used 
herein, the term "surface element" refers to triangular, 



876 

6 

or more generally polygonal, surfaces which are used to 
tile or tesselate, the desired surface. 

In the medical aspects of the present invention, a 
discriminating threshhold value or range may be chosen 
so as to selectively view various body structures. For 
example, if one wishes to view bony structures, a partic- 
ular threshhold value is chosen. However, if one wishes 
to view the surface structures of softer tissue, a different 
threshhold value is selected by the operator. In any 
event, the system for displaying such three dimensional 
surface structures should include accurate means for 
determining local surface normal directions, since it is 
these directions which greatly enhance the ability of the 
viewer to recognize the shading clues for a truly three 
dimensional representation. 

One of the significant features of the present inven- 
tion is the ability to perform rapid generation of coordi- 
nate values representing polygonal and, in particular, 
triangular surfaces. These polygonal surfaces approxi- 
mate the intersection of the desired surface with a three 
dimensional volume element. The eight values defined 
at the eight vertices of a three dimensional grid struc- 
ture are employed to generate an eight bit vector. This 
vector is employed as an address to rapidly generate the 
coordinate values. In each voxel element (defined by 
the eight cubically adjacent grid points), the object is to 
define a surface which separates included from ex- 
cluded vertices. In general, there are 256 cases which 
have to be analyzed for surface intersection arrange- 
ments. However, a significant observation of the pres- 
ent inventors has led to the conclusion that only 14 
cases actually need to be constructed. The present in- 
ventors have determined that by rotation about any of 
three mutually perpendicular axes and by employing 
binary complementation methods, the 256 cases actu- 
ally reduce to a mere 14 cases which require separate 
manual analysis (one additional trivial case requires no 
such analysis). Furthermore, the coordinate values may 
be readily obtained from an eight bit vector by means of 
a lookup table which is easily implemented in a read 
only memory (ROM). This method provides for rapid 
surface tesselation and offers two significant advan- 
tages. First, the vertices of the triangular or polygonal 
structures generated in the present invention, lie on the 
edges of cubical voxel grid patterns. This permits the 
use of interpolative methods for adjusting the position 
of the polygonal vertex along the cubical edge. This 
interpolation is done in accordance with the values 
occurring at each of the cubical vertices, which values 
may be treated as weights. This provides additional 
flexibility for more accurately approximating the de- 
sired surface to be viewed. Secondly, since the repre- 
sentational objects generated in the present invention 
comprise polygons and triangles, normals to these ap- 
proximating surfaces are readily computed and may be 
provided directly to devices designed for accepting 
display data in this form. This additional ability to accu- 
rately portray surface and surface normal information 
in a rapid fashion provides the present invention with 
significant advantages. Not the least of these advantages 
is the fact that the polygonal format generated is com- 
patible with advanced graphics workstations which are 
used to manipulate three dimensional surface data. It is 
also seen that the resolution of the images produced by 
the present invention are superior to previous methods 
since the signal information is interpolated, rather than 
quantized, to accurately determine surface position and 
normal direction. As pointed out above, it is the accu- 



11/13/2003, EAST Version: 1.4.1 



4,710,876 



rate portrayal of the surface and the surface normals 
which provide the essentia] clues for the visual percep- 
tion of displayed images as three dimensional objects. 

DESCRIPTION OF THE FIGURES , 

The subject matter which is regarded as the invention 
is particularly pointed out and distinctly claimed in the 
concluding portion of the specification. The invention, 
however, both as to organization and method of prac- 
tice, together with further objects and advantages 10 
thereof, may best be understood by reference to the 
following description taken in connection with the ac- 
companying drawings in which: 

FIG. 1 is a perspective drawing illustrating a vertex 
labelling scheme associated with each voxel in a three IS 
dimensional array of data; 

FIG. 2 is a perspective drawing illustrating an edge 
labelling scheme associated with each voxel element in 
a three dimensional array of data; 

FIGS. 3A-3N are perspective illustrations included 20 
for the purpose of demonstrating the fact that all 256 
intersection cases are reducable to only 14 distinct 
cases; 

FIGS. 4A-4N are perspective illustrations which 
show the specific polygon or triangle employed for 25 
each one of the 14 cases; 

FIGS. 4A'-4N' are plan views of the cube and sur- 
face structure shown in FIGS. 4A-4N, respectively; 

FIG. 4B" illustrates a plan view of FIG. 4B illustrat- 
ing a slightly different polygonal representation as com- 30 
pared with that shown in FIG. 4B'; 

FIG. 5 is a perspective view illustrating an interpola- . 
tion method employable in the present invention; 

FIG. 6A is an isometric view illustrating a network of 
quantized binary data points lying on the vertices of a 35 
cubical grid structure; 

FIG. 6B is an isometric view similar to that shown in 
FIG. 6A in which the present invention is illustrated for 
a set of contiguous voxel elements; 

FIG. 6C is an isometric view of the three dimensional 40 
surface structure produced in accordance with the pres- 
ent invention in FIG. 6B but drawn separately from the 
data points so as to provide a better view of the approxi- 
mating surface for the data elements shown in FIG. 6A; 

FIG. 7 is a plot of intensity as a function of pixel 45 
distance which particularly points out the ability to 
distinguish internal body structures as a function of the 
measurement of various physical properties; 

FIG. 8 is a flow chart illustrating data flow in the 
present invention; 50 

FIG. 9 is a functional block diagram more particu- 
larly illustrating functional components in a system 
constructed in accordance with the present invention; 

FIG. 10 is a photograph of a CRT image of the skull 
of a living human being shown from the front; 55 

FIG. 11 is a photograph of a CRT image of the side 
view of the same skull as shown in FIG. 10, this image 
being generated from the same data as FIG. 10; 

FIG. 12 is a photograph of a CRT display screen 
image of the skull shown in FIGS. 10 and 11, viewed 60 
from a more rearward position. 

DETAILED DESCRIPTION OF THE 
INVENTION 

An understanding of the present invention can only 65 
be had by fully understanding the method of surface 
approximation employed. Likewise, this surface ap- 
proximation method cannot be properly appreciated 
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without analyzing the 14 cases illustrated in FIGS. 3 
and 4. In order to understand the contents of these 
figures, one must first appreciate the vertex and edge 
labelling conventions employed. The vertex labelling 
scheme is illustrated in FIG. 1, which illustrates the 
labelling convention applied to eight cubical vertices, 
VI through V8, as shown. Likewise, FIG. 2 illustrates 
the labelling of the 12 cubical edges. In FIG. 1, the set 
of vertices illustrated are, in accordance with the defini- 
tion given above, describable as being cubically adja- 
cent. However, since scaling in any of three distinct 
directions is possible, it is understood that such points 
may also lie on the corners of a rectangular parallelopi- 
ped. However, the illustrations herein have been di- 
rected to regular cubical structures for purposes of 
clarity. It is pointed out that the illustrations in FIGS. 1 
and 2 have been drawn with edges E3, E4, and E8 being 
shown as dotted lines to reflect their presence at the 
rear of the structure, that is, they are illustrated as hid- 
den lines. This is also true of FIGS. 3A-3N and 4A-4N. 
It is noted that other vertex and edge labelling arrange- 
ments could just as easily have been employed without 
departing from the principles of the present invention. 
It is nonetheless important, however, to employ consis- 
tent edge and vertex labelling schemes. 

Before a detailed discussion of FIGS. 3 and 4 is un- 
dertaken, it is appropriate to point out several features 
which are common to all of these drawings. These 
drawings illustrate 14 cases that are included as part of 
the analysis made in the present invention. These 14 
cases have been reduced from a total of 2S6 possible 
cases. In each of the figures being considered, vertices 
are shown as filled in circles. Edges are depicted by 
open circles lying at the midpoints of the edges. In 
FIGS. 4A-4N, a surface or set of surfaces is shown. 
Each of these surfaces is defined by a sequence of edge 
points. Likewise, each surface is designed to isolate one 
or more of the eight vertices. In one case, only a single 
vertex must be isolated. In other cases, two, three, or 
four vertex points are to be isolated by triangular or 
polygonal surface approximations. These surfaces are 
approximations to the intersection of the desired surface 
with the voxel element. It is of course, understood that 
the entire surface is to be reconstructed from a plurality 
of these individual surface elements. In FIGS. 4A'-4N' 
and in 4B", indications are given for a vector normal to 
the approximating surfaces shown. In most cases, this 
normal direction is illustrated by circulating arrow fol- 
lowing the righthand rule convention. In each case 
illustrated, the normal direction has been selected to be 
directed away from the vertex which is being isolated 
by the surface. In at least one case, because of the orien- 
tation of the polygons generated, the surface normals 
themselves are visible (see FIG. 4J'). 

Attention is now directed to analyzing several exam- 
ples of the polygonal surfaces generated in accordance 
with the system and method of the present invention. 
These polygonal surfaces are generated in response to 
the production of an eight bit binary vector based upon 
data comparisons made at each set of eight cubically 
adjacent grid locations within the body being investi- 
gated. 

Attention is now specifically directed to case 1 as 
illustrated in FIGS. 3A, 4A, and 4A'. FIG. 3A illus- 
trates the case in which a single vertex is present at one 
of the eight vertex points of the cube. In FIG. 3A, ver- 
tex 1, or VI, is shown as being present. This corre- 
sponds to the situation in which data values associated 
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with the eight vertex points have been compared with a 
threshhold value with the result that only one of the 
associated vertex values was found to be above (or 
below) a threshhold value. It is the threshhold value or 
range of values which serves to isolate the particular 5 
surface or surfaces within the three dimensional body 
being considered. For ease of appreciating the geome- 
try, FIG. 3A shows a block in the comer associated 
with VI. For a proper understanding of the present 
invention, it should be appreciated that case 1 actually 10 
represents a plurality of subcases which are determined 
by rotation about various axes. For example, rotations 
about one or more orthogonal axes through an angle of 
90', can move the small, internal block of FIG. 3A into 
any desired corner of the cube. For example, rotation 15 
about a horizontal axis extending from the middle of the 
front face to the middle of the rear face of the cube 
shown can move the block from the VI position to the 
V5 position and then from V5 position to the V6 posi- 
tion, and then from the V6 position to the V2 position, 20 
or in the corresponding opposite direction. Likewise, 
rotations about other selected axes are capable of pro- 
ducing a situation which differs from the case illustrated 
only in specific orientation and not in geometric struc- 
ture. Likewise, case 1 also includes the complement 25 
situation in which vertices V2, V3, V4, V5, V6, V7, and 
V8 are turned "on" and in which VI is turned "off*. 
Thus, through rotational invariance and the use of com- 
plementary situations, it is appreciated that case 1 actu- 
ally stands for 16 subcases (8 rotational invariances and 30 
their corresponding 8 complement cases). 

One of the objects of the present invention is to gen- 
erate polygonal surfaces which represent surface ap- 
proximations. Consideration then is given to the nature 
of the surface which intersects the voxel shown in such 35 
a manner that vertices on one side of the surface exhibit 
data values greater than a specified threshhold, and 
vertices on the opposite side of the surface, represent 
vertices with data values less than the selected thresh- 
hold value. While it is exceedingly tedious to generate 40 
an answer for each of the 256 =2 8 possibilities (8 being 
the number of vertices), it can nonetheless be appreci- 
ated that rotational and complementary cases can act to 
reduce this number. In fact, a reduction from 256 sub- 
cases to a mere 14 principle cases is possible and is 45 
illustrated herein in the figures which follow. 

For the particular situation found in case 1, a triangu- 
lar surface is selected as most closely representing the 
desired surface. This triangle is specified by the triplet 
of numbers 1,4,5 representing, in sequence, edge El, 50 
edge E4, and edge E5. Once one knows the location of 
the particular cubical voxel element containing these 
edges and vertices.it is seen that it is immediately possi- 
ble to generate appropriate coordinate values for these 
edge points. These values may be provided in an integer 55 
format or in a floating point format, or in any other 
format suitable for computational purposes. It is also, of 
course, preferable that the format chosen match the 
capabilities and characteristics of various display pro- 
cessors usable in the present invention. Thus, a binary 60 
number such asOOOOOOOl representing the presence 
of vertex VI is employable as an address or index vector 
as a means for addressing, accessing, or generating the 
number triplet representing edges El, E4, and ES. 

As indicated above, surface normal directions are 65 
important in the practice of the present invention. Ac- 
cordingly, it is also desirable to be able to assign a sur- 
face normal direction associated with the triangular 



area shown in FIG. 4A. For this purpose, attention is 
directed to FIG. 4A' which is a plan view of FIG. 4A. 
FIG. 4A' also illustrates the presence of edges El, E4, 
and E5. Note however, that FIG. 4A' also associates 
this planar area with a counterclockwise arrow denot- 
ing, in accordance with the righthand rule, a normal 
direction pointing in a generally upward direction. This 
normal direction is of course, perpendicular to the pla- 
nar area shown in FIG. 4A. As pointed out above, it is 
the convention in the figures shown that the normal 
direction is selected to be in a direction away from the 
"on" vertex, here namely vertex VI. The orientation of 
the surface is preferably provided by an appropriate 
ordering of the vertices of the generated polygon. In 
this case, the sequence 1,4,5 also conveys information 
with respect to surface orientation. Alternate means for 
describing this surface also include the number triplet 
4,5,1 and the number triplet 5,1,4. However, solely for 
the purpose of ease of comparison and understanding, 
the general rule employed herein is to designate each 
such number triplet so as the numerically smallest num- 
ber is listed first. Accordingly, the planar area illus- 
trated in FIG. 4A is described by the number triplet 
1,4,5. Accordingly, this number triplet is entered in 
Table I below for the case 1 situation. 

TABLE I 



CASE 



VERTICES 
8765432 1 



TRIANGLES FOR CONNECTING 
EDGES 



0 


00000000 


000 


000 


000 


000 


1 


0000000 1 


145 


000 


000 


000 


2 


000000 1 1 


456 


24 6 


000 


000 


3 


00000 10 1 


145 


27 3 


000 


000 


4 


0 100000 1 


145 


7 10 11 


000 


000 


5 


0000 1 0 1 1 


5 68 


3 8 6 


236 


ooo 


6 


[000001 1 


8 11 12 


45 6 


246 


000 


7 


[0 10000 1 


145 


8 11 12 


6 9 10 


000 


8 


0000 1 1 1 1 


5 68 


67 8 


000 


000 


9 


00011011 


296 


239 


3 12 9 


3 8 12 


10 


oroioioi 


149 


4 12 9 


2 113 


2 10 11 


11 


1 000 1 0 1 1 


5 11 12 


3 11 5 


23 5 


000 


12 


0 1001011 


568 


38 6 


236 


7 10 11 


13 


loiooioi 


145 


6 9 10 


273 


8 11 12 


14 


1000 1110 


7 11 12 


7 12 4 


174 


000 



The various cases considered are also described in 
FIGS. 3 and 4. For convenience, Table II below is 
provided to facilitate reference to the appropriate fig- 
ures for the 15 cases presented herein. 

TABLE II 



CASE 



FIGURES 



0 


None 


1 


3A, 4A, 4A' 


2 


3B, 4B, 4B", 4B" 


3 


3C, 4C, 4C 


4 


3D, 4D, 4D' 


5 


3E, 4E, 4E' 


6 


3F, 4F, 4F' 


7 


3G, 4G, 4G' 


8 


3H, 4H. 4ff 


9 


31, 41, 41' 


10 


3J, 4J, 4J' 


11 


3K, 4K. 4K' 


12 


3L, 4L, 4L' 


13 


3M, 4M, 4M' 


14 


3N. 4N, 4N' 



Table I above is important for an. understanding of 
the operation of the present invention. This table is 
illustrative of the means employed herein for strategi- 
cally representing approximating surfaces using formats 
which are easily recognized by graphic display proces- 
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sors. Accordingly, the following conventions have been 
employed in the construction of Table I. In particular, 
for each eight bit vector address in the column labelled 
"VERTICES", there is a corresponding sequence of up 
to four number triplets representing appropriate triang- 5 
ular approximating surfaces. Each approximating sur- 
face is specified by a triplet of edge numbers. In each 
triplet, the lowest numerical edge number is employed 
first. Additionally, each set of triplets occurs in an order 
which is reflective of the surface normal direction 10 
chosen. It should, of course, be appreciated that by 
convention one could have selected surface normals to 
be oriented in the opposite direction. This is, however, 
merely a matter of design choice, the only important 
aspect being that a consistent choice be made. IS 

It should also be pointed out that the results gener- 
ated in Table I are dependent upon the specific labelling 
arrangement for the vertices and the edges of the cubi- 
cal or rectangular voxel element. However, once a 
labelling scheme is decided upon, it is important that the 20 
same labelling arrangement be employed in considering 
each of the cases listed. It is also useful to point out that 
in case 0, no triangular or other surface representational 
signals are generated since this corresponds to the situa- 
tion in which the surface selected does not intersect the 25 
chosen voxel element. Table I indicates this situation as 
a string of zeros in the row of Table I corresponding to 
case numeral 0. It is also noted that for each case, up to 
four triangular surface regions are generated from the 
table. However, it is noted that it is also possible to 30 
employ a table in which polygonal rather than triangu- 
lar surface approximations are generated. More is said 
about this particular point below. 

Consideration is next turned to case 2 as particularly 
illustrated in FIGS. 3B, 4B, 4B' and 4B". A generic 35 
form of case 2 is shown in FIG. 3B representing the case 
in which two adjacent vertices and only two such verti- 
ces are found to either exceed or fall below the selected 
threshhold value. In this case, "adjacent" means verti- 
ces having a single edge in common. For this reason, it 40 
is seen that case 2, as shown, actually includes 12 sub- 
■ cases corresponding to the selection of adjacent vertex 
pairs, or equivalently 12 edges. Additionally, it is seen 
that, by considering complementary cases, the number 
of actual subcases covered by case 2 is 24. It is thus seen 45 
that this is the manner in which the 256 possible cases 
are reduced to a manageable number in accordance 
with the present invention. For example, it is seen that 
case 2 covers those situations in which the following 
pairs of vertices are selected: V<5 and V7, V4 and VI, 50 
V3 and V7, V2 and V3, etc. When one considers com- 
plementary cases, it is seen that FIGS. 3B and 4B also 
include the case in which the data values associated 
with vertices V3, V4, VS, V6, V7, and V8 all either 
exceed or fall below a specified threshhold value. These 55 
subcase listings are, however, only exemplary of the full 
range of possibilities. Rotations of the three dimensional 
cube about any of its symmetry preserving axes clearly 
shows that all of these subcases are equivalent except 
for orientation. The basic structure of each case is none- 60 
theless distinct across the set of cases, but uniform 
within each of the subcase situations. 

FIG. 4B indicates the polygonal approximating sur- 
face generated in case 2. In particular, the polygon with 
vertices on edges 2, 4, S, and 6 (in that order) is the 65 
result. However, it is also seen that any polygonal ap- 
proximating surface which is generated may also be 
generated by a corresponding set of triangular surfaces. 
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These triangular surfaces are also illustrated in FIG. 4B. 
It is thus seen that case 2, using Table I, results in the 
generation of triangles 4, S, 6, and 2, 4, 6. The quadrilat- 
eral in this instances, is broken up into two triangles 
having the line joining edges E4 and E6 as a common 
edge. The top view of this configuration is shown in 
FIG. 4B'. However, it is also noted that it is possible to 
break up the quadrilateral into two triangles in the man- 
ner indicated in FIG. 4B" by including as a diagonal, 
the line joining edges E2 and E5. In those cases in 
which polygons having more than three sides are gener- 
ated, it is seen that this kind of potential ambiguity re- 
sults. However, image quality is not degraded in any 
significant fashion by this ambiguity as long as consis- 
tent choices are made. In the present invention, consis- 
tency is easily assured by using a fixed version of Table 
I throughout the generation of an image. However, it is 
noted that these kinds of variations in Table I are also 
included in the concept of the present invention. Thus, 
it would also be possible in accordance with FIG. 4B' to 
generate in case 2 of Table I, triangles 2, 4, 5, and 2, S, 
6, rather than triangles 4, 5, 6, and 2, 4, 6 without depart- 
ing from the spirit and scope of the present invention. 
The present invention also includes the concept of gen- 
erating quadrilaterals or other polygons in association 
with the various cases as appropriate. Thus, in case 2, it 
is also possible to employ a table which is used to gener- 
ate a quadrilateral described as an edge sequence. In 
case 2, this edge sequence would be 2, 4, 5, 6, or any 
cyclic permutation thereof, it being understood, of 
course, that cycles taken in the opposite direction pro- 
duce reversed normal directions. In this last regard, it is 
noted that all that is required in the practice of the 
present invention is consistency in the selection of the 
normal direction, either choice either being adequate in 
itself or readily compensated for. 

It is also appropriate to note that, with respect to 
Table I, the order in which the number triples are listed 
is not important. For example, for case 2, it would have 
been just as appropriate to list edge triple 2,4,6 before 
edge triple 4,5,6. 

Case 3, as illustrated in FIGS. 3C, 4C, and 4C, illus- 
trate the case in which a pair of facially diagonally 
disposed vertices are selected. This would include sub- 
cases such as: VI and V6, V4 and V7, V2, and V4, VS 
and V7, etc. As above, the complementary subcases are 
also covered by the same set of approximating surfaces 
but with their normal directions reversed. Case 3 is 
treated in much the same manner as the other cases. The 
significant new feature indicated in case 3 is the fact that 
the surface approximations generated in the present 
invention do not necessarily comprise contiguous sur- 
face elements. The resultant triangles generated in case 
3 are listed in Table I and effectively covers all those 
vertex pairs selections which lie on the same facial diag- 
onal. Since there are 6 faces and two diagonals per face, 
case 3 actually includes 12 uncomplemented subcases 
and 12 complementary subcases. Again, the reduction 
of the cases to a more manageable number is readily 
apparent 

Next is considered the situation occurring in case 4, 
which is particularly illustrated in FIGS. 3D, 4D, and 
4D'. Case 4 actually represents that set of subcases in 
which the pair of vertices selected lies on a body diago- 
nal of the cube. Since there are four such body diago- 
nals, case 4 corresponds to four uncomplemented sub- 
cases and four complemented subcases for a total of 
eight subcases. The surfaces generated in accordance 
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with the present invention are particularly illustrated in 
FIG. 4D. A top view of the cube shown in FIG. 4D is 
shown in FIG. 4D'. It is perhaps advantageous in this 
situation to note the directions of the circulating arrows 
shown. These "circulating arrows" orient the surface 5 
by specifying, the normal direction in accordance with 
the rigfathand rule. There is, of course, nothing special 
about specifying a righthand rule, the only important 
aspect being that consistency is m ai n tai n ed. 

It is also appropriate to note that the vertices of the to 
triangles shown in FIGS. 4A-4N are shown as lying at 
the midpoints of the edges of the cube. However, it is 
also important to note that a preferred embodiment of 
the present invention incorporates an interpolation 
mechanism which adjusts the position of the edge points 15 
in accordance with the data values obtained at the verti- 
ces of the voxel element. This provides significantly 
improved shading for the images generated, restoring 
much of the information potentially lost in establishing 
a dichotomizing surface between vertex points. 20 

Next is considered case S. Case 5 is handled in the 
same manner as the cases described above. However, 
the principal additional aspect now being the fact that 
three vertices are selected for separation. Case 5 covers 
all of those subcases in which the three vertices selected 25 
lie on the same face of the voxel element. It is is thus 
seen that there are then six uncomplemented and six 
complemented subcases of this sort. Thus, case 5 actu- 
ally incorporates 12 subcases. The practical effect of 
this incorporation is that a detailed analysis of each of 30 
the subcases is avoided, these being covered instead by 
equivalences induced by rotation and complementation 
operations. It is also seen that case 5 is different from the 
other cases considered so far in that there are actually 
three triangles generated. These triangles are listed in 35 
case 5 in Table I as triangles (edge lists) 5,6,8; 3,8,6; and 
2,3,6. The top view shown in FIG. 4E' provides a view 
which illustrates the use of circulating arrows to indi- 
cate surface orientation. The surface generated in case S 
not only includes three triangles, but it is seen that only 40 
two of these triangles lie in the same plane. However, it 
is noted that the planarity of the approximating surface 
which is generated is highly dependent upon modifica- 
tions made as a result of an interpolation step. It is also 
noted that a table of polygons, as opposed to triangles, 45 
could also be established so as to associate case 5 situa- 
tions with an edge list such as 2,3,8,5,6, or appropriate 
variations thereof as determined by particular subcases. 
However, the use of triangles is preferred since a finer 
resolution is generally obtained with more precise spec- 50 
ification of normal directions. 

Cases 6-14 are illustrated in FIGS. 3F-3N, FIGS. 
♦F-4N, and FIGS. 4F'-4N'. Case 14 in particular arises 
out of the fact that case 1 1 does not possess chiral sym- 
metry, that is, no rotation of the cubes in case 1 1 (FIG. 55 
3K) can orient the inner cubes in the manner illustrated 
in FIG. 3N. These two cases do, however, possess mir- 
ror image symmetry. This symmetry is reflected in 
FIGS. 4K and 4N. Cases 6-14 are constructed in the 
same manner as described above. These constructions 60 
are illustrated in the appropriate figures, as described in 
Table II. Accordingly, a detailed analysis of each of 
these cases is not necessary at this point since they are 
self-explanatory in light of the material above. How- 
ever, it is useful to consider these figures for the purpose 65 
of determining that the cases considered therein to- 
gether with appropriate symmetries induced by rotation 
and complementation serve to cover all of the remain- 



ing possibilities. It should also be noted that Table I, in 
the column labelled "VERTICES" provides in effect, 
an eight bit vector which is uniquely associatable with 
one or more edge sequences denoting triangles or poly- 
gons which approximate surface intersections with the 
cubical or rectangular voxel element. The analysis illus- 
trated in Table I is repeated for each of the voxel ele- 
ments and is used to provide a vector list for receipt by 
display processor means which is capable of converting 
the data list to either a vector scan format or to a raster 
scan format. 

FIG. 5 is important for an understanding of the inter- 
polation which is preferably employed in the present 
invention. FIG. 5 illustrates a voxel element with data 
values provided at each of the eight vertices. It is im- 
portant to note that the numbers shown at the vertices 
in FIG. 5 are data values, not vertex labels. In particu- 
lar, FIG. 5 illustrates case 2 with a threshhold value of 
6. It is seen that the only two vertices which exceed this 
value are the two lower front vertices, each having an 
assigned data value of 10. If this cube had been labelled 
with the vertices of FIG. 1, the corresponding labels 
would be VI and V2 (assuming that the cube in FIG. 1 
and FIG. S are oriented in the same direction). It is 
noted that each of the open circles in FIG. 5 have been 
displaced a certain distance from the midpoints of the 
edges. Thus, while the separating surface shown for 
case 2 in FIG. 4B is planar, it is seen that the interpola- 
tion provided in the present invention does not restrict 
the approximating surfaces in this manner. This results 
in much sharper images with improved three dimen- 
sional shading clues. It is seen that each of the vertex 
points for the triangles are moved along a voxel edge by 
a distance which is a function of the data values at the 
vertex points which determine the edge. For example, it 
is seen that the distance "a" along what corresponds to 
edge E2 may be chosen to be proportional to 3/(10+3) 
since 10 and 3 are the data values associated with this 
edge. In a like manner, the distances b, c, and d are 
chosen based upon the values at the vertex points which 
determine each edge. If desired, interpolation may also 
involve use of the selected threshold value. It is noted 
that the vertex points for the approximating surfaces 
generated in the present invention are therefore deter- 
mined in such a way that consistent approximating sur- 
faces are defined for adjacent voxel elements. Each 
voxel element is, of course, a cubical (but more gener- 
ally a parallelepiped) volume such as is shown in FIG. 
5 and the figures previously discussed. 

It is, of course, important to be able to piece together 
surface structure representations from the approximat- 
ing surfaces (polygons or triangles) generated for each 
voxel element. An example of this restructuring is pro- 
vided in FIGS. 6A, 6B, and 6C. FIG. 6A illustrates a 
small section of contiguous three dimensional voxel 
elements. Each filled-in circle located at a vertex point 
of a cube , in FIG. 6A corresponds to a comparison of 
the data value associated with that vertex and a thresh- 
hold level It is the threshhold level or range which 
operates to select the desired surface within the three 
dimensional array. Accordingly, it is an object of the 
present invention to rapidly determine and describe a 
surface which separates the vertices with filled circles 
in FIG. 6A from the rest of the vertices. These remain- 
ing vertices lie along the intersections of lines which are 
shown dotted in FIG. 6A. If one carries out the method 
of the present invention for the vertex set shown in 
FIG. 6A, the resulting surface structure is shown in 
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FIG. 6B. For purposes of clarity, the underlying surface data in an integer representation. However, the present 

structure is shown separately in FIG. 6C. In FIGS. 6B invention is capable of employing data in any format 

and 6C, the vertex points of the approximating surfaces containing totally ordered (in the mathematical sense) 

chosen are shown as open circles. It should be noted data elements. 

that, for clarity, FIGS. 6B and 6C do not include any 5 A data flow diagram of the present invention is 
interpolative modifications of the vertex points. The shown in FIG. 8. In particular, data from magnetic 
structure of the output presented in FIG. 6C is best resonance or computed tomography systems is illus- 
described as being in vector form, that is, a sequence of trated as being supplied to a set of intensity registers, 
connected vertex points. In one embodiment of the Typically, the data is structured in the form of a plural- 
present invention, the data embodying FIG. 6C com- 10 ity of layers. In the present invention, only two adjacent 
prises a list of such vectors in three dimensions. The list layers are required at one time for data processing, 
may also include a normal vector associated with each Even more particularly, a single voxel element at a time 
triangular or polygonal region. It is noted that different is analyzed, each voxel element comprising a set of 
display processors require data in somewhat different eight cubically adjacent data points. The term "cubi- 
forms. However, the method and apparatus of the pres- IS cally adjacent" has been defined above. It is noted 
ent invention are capable of generating data signals in though that the structure of the present invention 
any appropriate format. It is further noted that, in a readily permits the use of parallel processing systems, 
preferred embodiment of the present invention, a The values in the intensity registers are compared 
shaded, rasterized image is produced in which each with a predetermined constant for each voxel element 
triangular or polygonal surface approximation is shaded 20 present. In general, the constant or threshhold of com- 
on a gray scale basis in dependence upon the relation parison is the same for each voxel element This com- 
between the viewing angle selected with respect to the parison generates an eight bit vector which acts as an 
direction of the normal vector to the approximating index to a table of edges. An abbreviated edge table is 
surface element. To produce smoothly shaded images, shown in Table I for the IS major case occurrences of 
the unit normal of each triangle sharing a common 25 the present invention. The other cases being merely 
vertex is averaged together at the vertex to produce a obtained from the 15 cases by rotation or complementa- 
shared normal. The graphics processor may used shared tion. The data from the edge table is then used in con- 
normals to grade the calculated intensity over the po- junction with the data at the vertex points, as contained 
lygonal facet to create a smoothly shaded image. These in the intensity registers to generate a set of points or 
surface elements are generated for each voxel element 30 vectors which are preferably interpolated in the manner 
which experiences an intersection with the desired sur- described above. The threshhold constant may also be 
face. Examples of the resulting images are more particu- employed in this interpolation. The interpolated data 
larly described in FIGS. 10, 11, and 12, discussed more together with a list of table edges, is then supplied to a 
fully below. geometry engine, or display processor, which operates 
As pointed out above, it is the threshhold value or 35 to generate either vector or raster format images. In 
range which determines the surface or surfaces to be preferred embodiments of the present invention, the 
reconstructed on a display device in accordance with raster format is generated since this format provides 
the present invention. From the point of view of medi- better visual clues for three dimensional images. The 
cal imaging applications, one of the significant advan- resultant image is then typically displayed on a screen 
tages of the present invention is that one can selectively 40 such as a cathode ray tube (CRT), 
view a plurality of different tissue types. The type selec- It is noted that since the present invention is capable 
tion is made on the basis of observed physical proper- of displaying multiple tissue types, particularly from 
ties. For example, in computed x-ray tomography sys- data generated from nuclear magnetic resonance imag- 
tems, the physical property of import is the x-ray ab- ing systems, it is possible to employ color in the dis- 
sorption capabilities of various bodily tissues. For exam- 45 played image. For example, it is highly suggestive to 
pie, x-ray absorption in bone is much higher than ab- view images of bone surfaces in black and white. Other 
sorption in skin and other tissues. This fact is particu- tissue types may be displayed in various shades of pink 
larly illustrated in FIG. 7 which is a sample plot of x-ray and gray to more closely match actual anatomical con- 
absorption intensity as a function of pixel distance. In ditions. This feature of the present invention is easily 
particular, regions for bone and skin are indicated in the 50 provided by using the threshhold value to control the 
figure. It is these physical differences, sampled in a three color on the display device. 

dimensional space which facilitates the construction of FIG. 9 illustrates a system for imaging in accordance 
three dimensional surface images in the present inven- with the present invention. Three dimensional data is 
tion. While FIG. 7 is particularly directed to the situa- provided by an NMR or computed tomography system, 
tion occurring in x-ray tomography, it is pointed out 55 As discussed above, other three dimensional data 
that the present invention is not so limited and is usable sources may also be employed. Typically, this informa- 
in any situation in which physical properties of the body tion is supplied to a storage system for such three di- 
being studied are sampled at regularly spaced portions mensional data. This system typically includes magnetic 
throughout the three dimensional extent of the body. or other storage media. However, the data may be sup- 
Such data is also generated in nuclear magnetic reso- 60 plied directly to a sufficiently larger random access 
nance imaging systems, ultrasound systems, scintillation device. It is noted, however, that it is only necessary to 
systems, and systems employing such methods as posi- consider adjacent layers at a single time. In fact, it is 
tron emission tomography. For example, in magnetic only necessary to extract data from eight cubically 
resonance imaging, measurable physical properties can adjacent data points at one time. A voxel scanner selects 
include spin-spin and spin-lattice relaxation times. It is 65 the particular set of eight data points for processing, 
noted, however, that the list of these systems is exem- These eight data points are supplied to a comparator 
plary and that the present invention is not limited which is also supplied with a threshhold value or range 
thereto. Additionally, many of these systems generate of values. The comparator generates an eight bit vector 
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as described above. The eight bit vector is then supplied The invention claimed is: 

to a polygon generator. The polygon generator may 1. A system for displaying three dimensional surface 

comprise a read only memory incorporating the full structures comprising: 

version of Table I with 256 rows constructed as de- means for storing three dimensional signal patterns 

scribed above. A scanning signal is employed to syn- 5 representing the value of at least one physical prop- 

chronize the operation of the scanner and the generator. erty associated with a three dimensional body at 

The scanner also supplies the set of eight voxel signals . regularly spaced grid locations within said body; 

to an interpolator which is supplied with the threshhold means for retrieving the eight three dimensional sig- 

value and with the set of vectors from the polygon na ] pattern values associated with each set of cubi- 

generator. As described above, an interpolation opera- 10 gjjjy adjacent grid locations within said body; 

tion is performed to generate a polygonal surface ap- means for comparing each set of said eight values 

proximation to the selected surface. The polygonal a predetermined threshold value to generate 

approximation is particularly adjusted for the proper m dght bit binary vector ^j, of whose e i emcnts « 

normal direction by the interpolator. The scanning zero or one, based on the result of said comparison; 

generation and interpolation operations are performed 15 means for generatmg a set Q f coordinate values for 

sequentially for each of the voxel elements m the data to each distmct binary vector said values 

generate a polygon list which is supplied to a display representing the vertices of at least one predeter- 

processor. Such display processors are readily available , ^ surface which approximates the 

and are well known to those skilled m the computer mterS ec t ion of surfaces determined by said thresh- 

aided drafting and design and computer aided manufac- 20 d sajd ^ 

runng arts (CAD/CAM). In such devices a viewing coordinate values also being de- 

du-ection is typically selected. This view control is se- »* v ' . . . . , . . . °. 

lectable by tte operator. The display processor then P«*«* ™ ^location of said eight grid locations 

generates a vector or raster format signal which is sup- within said body, 

plied to a CRT display device. 25 display processor means for receiving said coordinate 

The benefits accorded the practice of medicine by the ^ves and for converting said coordinate values to 

present invention are readily apparent in FIGS. 10, 11, a display format; and 

and 12. It is important to bear in mind that these three means for displaying surfaces determined by said 

figures represent medical images derived from a living threshold, said display means being driven by said 

human being. No invasive methods were employed to 30 display processor. 

generate these images. It is also noted that all of these 2. The system of claim 1 in which said means for 

images were generated from the same set of data ac- generating said coordinate values includes a read only 

quired at a single time. The appearance of the removal memory addressed by said eight bit vector, 

of the top of the cranium is only a result of data selec- 3. The system of claim 1 in which said display proces- 

tion. In fact, by merely removing selected segments of 35 sor means includes means for hidden line removal, 

data from the three dimensional data set, cross sectional 4. The system of claim 1 in which said display format 

views of saggital, transverse, or coronal sections are is vector based. 

easily generated. Other views are equally possible sim- 5. The system of claim 1 in which said display format 

ply by performing a rotation operation prior to data is raster based. 

selection. This is easily controlled by selecting the view 40 j. The system of claim 5 in which said raster based 
direction. In FIGS. 10-12 it is also seen that the subject format provides a shaded display region for each visible 
has been fitted with an endotrachial tube. The arch of polygon in response to the normal direction associated 
this tube is readily apparent in all of the views and it is with said polygon in three dimensional space in further 
particularly interesting to note its appearance and posi- response to a selected viewing angle, 
tion in FIG. 12. In the subject being studied, it is seen 45 7 -j-j^ S y S tem of claim 1 in which said physical prop- 
that there is a bone defect at the base of the left eye erty ^ the x . ray absorption characteristic throughout 
between the nose and the eye. Views of this defect are O ody. 

also obtainable from the back, through any selected 8 ^ ' system of c)aim i m wh j c h said physical prop- 
plane and at any desired viewing angle. Thus, a diagnos- ^ ^ nuclear spin density throughout said body as 
tician or surgeon is readily capable of viewing the exact 50 ided b nucIear magnetic resonance imaging de- 
structure that a corrective procedure would encounter. vices 

Additionally, the medical practitioner is given a view ^ m rf daim t m combmation with a com . 

^V^ 11 ^ 66 dm T 1 ^ ^ ^ *W P«ed tomography x-ray scanner for supplying three 

vided by the shading produced in accordance with the . . . , „ , : J' „i« 

present ation, li is the determination of appropriate 55 d-mensional signal patterns representing x . ray absorp- 
normal directions which permits such enhanced shad- *»- f°i storage m said storage means, 
ing features to be provided in medical images. , 10 - e svstem ° f claun 1 m . combination with a nu- 
ll is noted that many of the functions performed by clear magnetic resonance imaging system for providing 
the various parts of the system illustrated in FIG. 9 may three dimensional signal patterns representing nuclear 
in fact be performed through the use of one or more €0 s P m density, for storage in said storage means, 
general or special purpose digital computation systems. . «• The system of claim 1 further including interpola- 
While the invention has been described in detail tion means receiving said eight three dimensional signal 
herein in accord with certain preferred embodiments pattern values and said associated coordinate values and 
thereof, many modifications and changes therein may operating to adjust the values of said coordinate values 
be effected by those skilled in the art. Accordingly, it is 65 in response to weight values dependent on said eight 
intended by the appended claims to cover all such modi- signal pattern values so as to provide linear interpola- 
flcations and changes as fall within the true spirit and tion along the edges of the voxel elements defined by 
scope of the invention. said eight grid locations. 
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12. The preprocessor of claim 11 in which said means 
for storage, retrieval and comparison comprises a digi- 
tal computer. 

13. A preprocessor for a display system for three 
dimensional images, said preprocessor comprising: 5 

means for storing three dimensional signal patterns 
representing the value of at least one physical prop- 
erty associated with a three dimensional body at 
regularly spaced grid locations within said body; 

means for retrieving the eight three dimensional sig- 10 
nal pattern values associated with each set of cubi- 
cally adjacent grid locations within said body; 

means for comparing each set of said eight values 
with a predetermined threshold value to generate 
an eight bit binary vector each of whose elements is IS 
zero or one, based on the result of said comparison; 
and 

means for generating a set of coordinate values for 
each distinct binary vector, said coordinate values 
representing the vertices of at least one predeter- 20 
mined polygonal surface which approximates the 
intersection of surfaces determined by said thresh- 
old value with the volume defined by said eight 
grid points, said coordinate values also being de- 
pendent on the location of said eight grid locations 25 
within said body. 

14. A method for producing, on a display device, 
three dimensional surface representations, said method 
comprising the steps of: 

generating three dimensional signal patterns, said 30 
signal patterns representing the values of at least 
one physical property associated with a three di- 
mensional body at regularly spaced grid locations 
within said body; 

generating an eight bit vector for each set of eight 35 
cubically adjacent locations throughout said body, 
said locations corresponding to said regularly 
spaced grid locations, said vector being determined 
by comparison of said physical property represen- 
tational values with a predetermined threshold 40 
value; 

generating a set of coordinate values in response to 
each distinct eight bit vector and said eight grid 
locations, said coordinate values representing ver- 
tices of at least one predetermined polygonal sur- 45 
face which approximates the intersection of sur- 
faces determined by said threshold value with the 
volume defined by said eight grid locations, said 



coordinate values also being dependent upon the 
location of said grid locations within said body; and 
supplying said coordinate values to a display proces- 
sor and display device for generation of an image 
representative of at least one surface within said 
body, said surface being determined by said thresh- 
old value. 

15. A system for displaying three dimensional surface 
structures comprising: 

means for storing three dimensional signal patterns 
representing the value of at least one physical prop- 
erty associated with a three dimensional body at 
regularly spaced grid locations within, said body; 

means for retrieving the three dimensional signal 
patterns values associated with said grid within 
said body; 

means for comparing the set of said signal patterns 
with a predetermined threshhold value; 

means for tesselating the output of said comparison, 
said tesselation means generating polygonal sur- 
faces which approximate the intersection of sur- 
faces determined by said threshhold value with 
voxel elements defined by said grid, said polygonal 
surfaces having surface normals substantially dif- 
ferent from the three major axes of the grid; 

display processor means for receiving tesselated out- 
put and for converting said output to a display 
format; and 

means for displaying surfaces determined by said 
threshhold, said display means being driven by said 
display processor. 

16. The system of claim 14 in which said tesselation 
means includes 

means for comparing each set of eight values associ- 
ated with cubically adjacent grid points, with a 
predetermined threshhold value to generate an 
eight bit binary vector each of whose elements is 
zero or one, based on the result of said comparison; 

means for generating a set of coordinate values for 
each distinct binary vector, said coordinate values 
representing the vertices of at least one predeter- 
mined polygonal surface which approximates the 
intersection of surfaces determined by said thresh- 
hold value with the volume defined by said eight 
grid points, said coordinate values also being de- 
pendent on the location of said eight grid locations 
within said body. 
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